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This application is a continuation of U.S. Application No. 09/640,346, filed on 
August 16, 2000, which claims the benefit of U.S. Provisional Application No. 
5 60/ 1 49, 1 7 1 , filed on August 1 7, 1 999. The entire teachings of the above applications 
are incorporated herein by reference. 

This application is related to U.S. application 09/640,246 of common assignee, 
"Spray Data Acquisition System", inventor Dino J. Farina, filed on August 16, 2000, 
which claims the benefit of U.S. Provisional Application No. 60/149,281, filed on 
10 August 17, 1999. The entire teachings of the above applications are incorporated herein 
by reference. 



BACKGROUND OF THE INVENTION 

The present invention relates to the field of aerosol spray characterization, and 
more particularly, to computer assisted methods of analyzing and characterizing a set of 

1 5 sequential images corresponding to the progression of an aerosol spray. 

The fluid dynamic characterization of the aerosol spray emitted by metered nasal 
spray pumps and metered dose inhalers is crucial in determining the overall 
performance of the inhaler as a drug delivery device ("DDD"). In addition to treating 
direct respiratory ailments, inhaler-based DDDs are now increasingly being used to 

20 deliver drugs such as flu vaccines, insulin and migraine headache relievers because they 
deliver their dose of medication to tissues that can more efficiently absorb the drug and 
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bring relief to patients more conveniently. Spray characterization is also an integral part 
of the regulatory submissions necessary for Food and Drug Administration ("FDA") 
approval of research and development, quality assurance and stability testing procedures 
for new and existing inhaler-based DDDs. 
5 Thorough characterization of the spray's geometry has been found to be the best 

indicator of the overall performance of most inhaler-based DDDs. In particular, 
measurements of the spray's divergence angle (plume geometry) as it exits the device; 
the spray's cross-sectional ellipticity, uniformity and particle/droplet distribution (spray 
pattern); and the time evolution of the developing spray have been found to be the most 
10 representative performance quantities in the characterization of an inhaler-based DDD. 
During research and development, these measurements are typically used to 
optimally match the spray pump's performance characteristics with the fluid properties 
of the liquid/solid medicine solution, resulting in a more cost-effective and efficient 
product design. However, accurate, reliable and easy-to-use protocols and a system for 
15 inhaler-based DDD spray characterization do not exist. During quality assurance and 
stability testing, plume geometry and spray pattern measurements are key identifiers for 
verifying consistency and conformity with the approved data criteria for the inhaler- 
based DDD. 

The currently adopted inhaler spray testing standard that is in use today at 
20 pharmaceutical companies involves firing the spray pump at a solid, thin-layer 

chromatography ("TLC") plate having a coating that fluoresces in response to incident 
ultraviolet ("UV") radiation. The TLC plate is positioned at a fixed height above the 
exit port of the pump. The pattern of the spray deposited on the plate is then analyzed. 
In a conventional test configuration, the analysis of an exposed plate begins with 
25 illumination of the plate with UV radiation. The incident UV radiation causes the 
plate's coating to fluoresce and helps to highlight the outline of the spray pattern. 
Marking instruments and mechanical calipers are then used to draw and measure an 
outline of the deposited patterns on the plate. Measurements of the spray pattern's 
ellipticity in terms of major-and minor-diameters are recorded. 
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One disadvantage to this configuration is that the presence of the TLC plate 
radically alters the natural fluid dynamics of the spray causing it to switch from a free 
aerosol j et to an impinging j et. 

Another disadvantage to this configuration is that a large of amount of the spray 
5 particles bounce off the plate, causing artifacts in the pattern that do not exist in an 
unconstrained spray. This is especially problematic for dry powder-based DDDs 
because the particles don't tend to stick to the TLC plate at all causing artificially low 
spray pattern densities to be measured and reported. 

Yet another disadvantage to this configuration is that the measurements of the 
1 0 spray pattern are very sensitive to the operator's judgement and prone to low reliability. 

A further disadvantage to this configuration is that the associated measurement 
technique is restricted to measurements only of the static aspects of the spray pattern; it 
cannot be used to investigate any time-evolving or plume geometry properties of the 
spray. 

15 It is an object of the present invention to substantially overcome the above- 

identified disadvantages and drawbacks of the prior art. 

SUMMARY OF THE INVENTION 

The current invention provides an imaging and analysis system that receives 
information representative of the time evolution of an aerosol spray, displays individual 

20 and sequential images of the spray with respect to various observation angles, and 
characterizes parameters relating to the spray, such as the spray plume central axis, 
divergence angle and cross-sectional uniformity and ellipticity. In a preferred 
embodiment, the imaging and analysis system includes software running on a general 
purpose computer system. 

25 The foregoing and other objects are achieved by the invention which in one 

aspect comprises a method of analyzing image data representative of a sequential set of 
images of a spray plume, each of the images being representative of a density 
characteristic of the spray plume (i) along a geometric plane that intersects the spray 
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plume, and (ii) at a predetermined instant in time. The method includes sequentially 
displaying the set of images so as to exhibit a time evolution of the spray plume along 
the geometric plane, and measuring one or more spray plume parameters associated with 
the spray plume within one or more of the images. 
5 In another embodiment of the invention, the one or more parameters includes the 

central axis of the spray plume. 

In another embodiment of the invention, the one or more parameters further 
includes an angle measured from the central axis of the spray plume to an outer 
boundary of the spray plume. 
10 In another embodiment of the invention, the one or more parameters includes 

one or more cross-sectional axes of the spray plume. 

Another embodiment of the invention further includes superimposing a shape 
upon the one or more images so as to delineate an area of the spray plume, and 
measuring one or more spray plume parameters within the area. 
1 5 In another embodiment of the invention, the spray plume parameters are selected 

from the group consisting of area start X and Y coordinates, area end X and Y 
coordinates, area width, area height, mean spray intensity, spray standard deviation, 
minimum spray intensity, maximum spray intensity, and spray intensity histogram. 
Another embodiment of the invention further includes superimposing a line 
20 upon the one or more images so as to delineate an axis of the spray plume, and 
measuring one or more spray plume parameters along the axis. 

In another embodiment of the invention, the spray plume parameters are selected 
from the group consisting of axis start X and Y coordinates, axis end X and Y 
coordinates, axis length, axis width, axis height, axis angle, mean spray intensity, spray 
25 standard deviation, minimum spray intensity, maximum spray intensity, and spray 
intensity profile. 

Another embodiment of the invention further includes inserting one or more 
calibrating components associated with displaying the images so as to associate physical 
coordinates with image coordinates within each of the set of images. 
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Another embodiment of the invention further includes integrating the set of 
images so as to exhibit a time-average representation of the images, and measuring one 
or more parameters of the time average representation. 

In another embodiment of the invention, the time-average representation of 
5 images corresponds to an axial cross-sectional density characteristic along a geometric 
plane substantially normal to a flow direction centerline, such that the step of integrating 
produces a cross-sectional spray pattern image. 

In another embodiment of the invention, the time-average representation of 
images corresponds to a longitudinal density characteristic along a geometric plane 
1 0 substantially parallel to and intersecting the flow direction centerline, such that the step 
of integrating produces a longitudinal plume image. 

Another embodiment of the invention further includes subtracting a first in time 
image of the set of images from the time-average representation, so as to remove one or 
more common image components of the set of images from the time average 

15 representation. 

In another aspect, the invention comprises a system for analyzing image data 
representative of a sequential set of images of a spray plume, each of the images being 
representative of a density characteristic of the spray plume (i) along a geometric plane 
that intersects the spray plume, and (ii) at a predetermined instant in time. The system 

20 includes a processing device for receiving the set of images, and sequentially displaying 
the set of images so as to exhibit a time evolution of the spray plume along the 
geometric plane. The system further includes a controller, associated with the 
processing device, that provides a user interface for controlling the processor to measure 
one or more spray plume parameters associated with the spray plume within one or 

25 more of the images. 

In another embodiment of the invention, the one or more parameters includes the 

central axis of the spray plume. 
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In another embodiment of the invention, the one or more parameters further 
includes an angle measured from the central axis of the spray plume to an outer 

boundary of the spray plume. 

In another embodiment of the invention, the one or more parameters includes 

5 one or more cross-sectional axes of the spray plume. 

In another embodiment of the invention, the controller further (i) superimposes a 
shape upon the one or more images so as to delineate an area of the spray plume, and 
(ii) measures one or more spray plume parameters within the area. 

In another embodiment of the invention, the spray plume parameters are selected 
10 from the group consisting of area start X and Y coordinates, area end X and Y 

coordinates, area width, area height, mean spray intensity, spray standard deviation, 
minimum spray intensity, maximum spray intensity, and spray intensity histogram. 

In another embodiment of the invention, the controller further (i) superimposes a 
line upon the one or more images so as to delineate an axis of the spray plume, and (ii) 
1 5 measures one or more spray plume parameters along the axis. 

In another embodiment of the invention, the spray plume parameters are selected 
from the group consisting of axis start X and Y coordinates, axis end X and Y 
coordinates, axis length, axis width, axis height, axis angle, mean spray intensity, spray 
standard deviation, minimum spray intensity, maximum spray intensity, and spray 

20 intensity profile. 

Another embodiment of the invention further includes one or more calibrating 
components for associating physical coordinates with image coordinates within each of 
the set of images. 

In another embodiment of the invention, the processor further integrates the set 
25 of images so as to exhibit a time-average representation of the images, and measuring 
one or more parameters of the time average representation. 

In another embodiment of the invention, the time-average representation of 
images corresponds to an axial cross-sectional density characteristic along a geometric 
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plane substantially normal to a flow direction centerline, such that the step of integrating 
produces a cross-sectional spray pattern image. 

In another embodiment of the invention, the time-average representation of 
images corresponds to a longitudinal density characteristic along a geometric plane 
5 substantially parallel to and intersecting the flow direction centerline, such that the step 
of integrating produces a longitudinal plume image. 

In another embodiment of the invention, the processor further subtracts a first in 
time image of the set of images from the time-average representation, so as to remove 
one or more common image components of the set of images from the time average 

10 representation. 

In another embodiment of the invention, the processing device includes a 
computer system executing software operative to analyze the image data. 

BRIEF DESCRIPTION OF DRAWINGS 

The foregoing and other objects of this invention, the various features thereof, as 
1 5 well as the invention itself, may be more fully understood from the following 
description, when read together with the accompanying drawings in which: 

FIG. 1 illustrates a block diagram of a spray data analysis and characterization 
system according to the present invention; 

FIG 1 A illustrates a calibration image within a user interface display for 
20 assigning calibration parameters and other information to the image; 

FIG. 2 shows the VCR-like controls for manipulating the sequential set of spray 

plume images; © 
FIG. 3 illustrates one embodiment of a user-interface screen for setting the 

parameters of a time-average image; 
25 FIG. 4 shows a user-interface screen for quantifying the spray particle intensity 

distribution inside a "virtual" rectangular area or region of the images depicting the 
spray plume; and, 
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FIG. 5 shows a user interface screen for quantifying the spray particle intensity 
across a "virtual" line in the images. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The spray data analysis and characterization system of the present invention 
5 receives data representative of a sequential set of images of a spray plume. Each of the 
images is preferably representative of a density characteristic of said spray plume (i) 
along at least one geometric plane that intersects the spray plume, and (ii) at a 
predetermined instant in time. 

In one preferred embodiment, one of the geometric planes includes the flow- 
1 0 direction centerline of the spray plume (also referred to herein as the central axis of the 
spray plume), and one of the geometric planes is perpendicular to the central axis, 
although the present invention may be used to analyze other planes through the plume. 
Using the sequential set of images, the system displays a time-evolution of the plume 
from inception to dissipation, and derives physical parameters of the of the plume, such 
1 5 as particle distribution and divergence angle of spray patterns. In general, the system 
provides information regarding time-evolution of the transient spray plume; it time- 
averages the 100+ images typically acquired in a short-duration spray test; it facilitates 
visualization and measurement of the spray pattern depicted in the image sequence, and 
facilitates visualization and measurement of the spray plume geometry. 
20 FIG. 1 illustrates a block diagram of a spray data analysis and characterization 

system 100 according to the present invention. The system 100 includes a computer 
platform 102, a user input terminal 104, a display 106, an image input port 108, and 
system software 1 10. The software 1 10 resides in memory that is part of the computer 
platform 102. The computer platform is preferably a general purpose computer, such as 
25 a PC type computer or a workstation, although other embodiments may include other 
types of computer platforms known to those in the art (e.g., an application-specific 
device dedicated to the spray data analysis and characterization described herein). In one 
preferred embodiment, the computer platform 102 includes an Intel Pentium-based 
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computer system running a Windows NT 4.0 operating system. The user terminal 104 
may include a keyboard, a mouse, and/or other user input devices known to those in the 
art. 

The data representative of a sequential set of images of a spray plume preferably 
5 includes data for spatial calibration so that a user can associate real physical coordinates 
(e.g., mm, cm, inches, etc.) with image coordinates (e.g., pixels). A calibration image 
may be used for this purpose, although other calibration methods known to those in the 
art may also be used. FIG. 1 A illustrates one preferred calibration image within a user 
interface display for assigning calibration parameters and other information to the 
10 image. Further, the calibration image may be used to correct for perspective distortions 
due to less than ideal placement of the image acquisition equipment used to acquire the 
image sequence. The calibration parameters may be modified once the calibration 
image has been entered into the system. The values of Xmin, Ymin, and the position of 
the of the reference axes may be varied, and the system automatically adjusts all of the 
15 spatial measurements accordingly. 

In a preferred embodiment, the system manipulates the sequential set of spray 
plume images via VCR-like controls, as illustrated in FIG. 2. Through the use of these 
controls, the image sequence maybe displayed forward and backward, and at fast or 
normal speeds. Fast speed plays the images back as fast as possible where normal plays 
20 them back with a predetermined delay (e.g., 300ms) between the individual images 
(frames). These VCR-like controls enable a frame-by-frame progression through the 
sequence for pinpoint accuracy, and for easy visualization of the time evolution and 
spatial development of the spray. 

The analysis and characterization system further provides a time-average image 
25 (also referred to as a summary image) of the spray by collapsing all of the images in the 
sequence into one frame. The result is a single image that is representative of the time- 
average of the all the images. In practical terms, the time-average represents the fluid 
dynamic streak-lines of the spray or the trajectory of the particles as they move in time. 
In photographic terms it is equivalent to a time-lapse photo (e.g., well known photos of 
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automobiles moving through traffic at night with their head-and tail-lights forming the 
streak-lines). For spray characterization, this representation of the images facilitates 
quantitative measurements of the plume geometry and spray patterns much more 
accurately and more representative of the average trajectory of spray particles. 
5 FIG. 3 illustrates one embodiment of a user-interface screen for setting the 

parameters of a time-average image. Such parameters may include, but are not limited 
to, (i) the images to be included in the sum and (ii) a noise threshold level. The 
included images are selected with a Limits Control, which automatically display the 
Start, End and Number of Frames that have been selected. The Limits Control makes it 
1 0 possible to process only the images in the sequence that display active spray particles, 
and to ignore the others. The Noise Threshold control makes it possible to remove 
background noise (or particles that have intensity levels lower than the threshold 
specified) from the process and this leads to cleaner time-averages with better isolation 
of the actual spray particles from the background. 
15 In one embodiment, the system automatically subtracts the first frame of the 

sequence (i.e., prior to any spray droplets being ejected from the spray nozzle) from 
images in the time-average, thus removing that static (or common) portions of each 
image, resulting in a much more clear and accurate time-average. For example, the 
spray nozzle is constant and does not vary from image to image. By subtracting the first 
20 image from the rest of the images, the nozzle is essentially removed from the image. 

The system may further be used to quantify the particle intensity distribution 
inside a rectangular area or region of the images. This information can be computed and 
displayed across "virtual" regions in any number of the images without physically 
disturbing the flow as shown in FIG. 4. In one preferred embodiment, a user draws (i.e., 
25 superimposes upon the image sequence) an area. The system automatically provides the 
following information regarding the drawn area: the Start X, Y and End X, Y 
coordinates, Width, Height, statistical information including Mean, Standard Deviation, 
Minimum and Maximum values and the intensity Histogram. The drawn areas are 
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generally rectangles, although the drawn areas maybe selectively restricted to squares or 
other advantageous shapes for a particular application. 

For elliptical areas or regions of the images the system may automatically 
provide the information about the area major and minor elliptical diameters, angle of the 
area elliptical axes, geometrical ratio, elliptical ratio, and spray intensity profiles along 
the major and minor axes. The border of the area may be defined using a spray particle 
intensity threshold. 

The system may also be used to quantify the spray particle intensity across a 
"virtual" line in the images without physically disturbing the flow, as shown in FIG. 5, 
where the "hollow-cone" spray distribution, well known to those in the art, is clearly 
visible and quantifiable. This "line tool" functions as a "non-disturbing observer" of the 
particles in the flow. The line tool can be used on one image and then superimposed on 
other images in the time-evolution to monitor how and where the spray pump distributes 
particles as a function of time. The system automatically provides the following 
information once the "virtual" line has been drawn and superimposed upon the image 
sequence: the Start X, Y, and End X, Y coordinates, Length, Width, Height, Angle (with 
respect to a reference axis, e. g., the plume central axis), statistical information 
including Mean, Standard Deviation, Minimum and Maximum values and the particle 
intensity Profile. The line can be drawn in any orientation and length, although in some 
embodiments the line definition can be restricted to vertical and horizontal orientation 
by holding down the SHIFT key before drawing with the cursor. 

Appendix A in the United States Provisional Application Number 60/149,171 
shows an exemplary User's Manual for the invention. Appendix A is a manual for an 
entire spray characterization system, including information regarding acquisition, 
processing, set up, calibration, safety issues, et al. Some of the information in the 
User's Manual is beyond the scope of this specification. 

The invention may be embodied in other specific forms without departing from 
the spirit or essential characteristics thereof. The present embodiments are therefore to 
be considered in respects as illustrative and not restrictive, the scope of the invention 
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being indicated by the appended claims rather than by the foregoing description, 
changes which come within the meaning and range of the equivalency of the clai 
therefore intended to be embraced therein. 



